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Abstract — A multi-hop two-way relay channel is considered in 
which all the terminals are equipped with multiple antennas. 
Assuming independent quasi-static Rayleigh fading channels 
and channel state information available at the receivers, we 
characterize the optimal diversity-multiplexing gain tradeoff 
(DMT) curve for a full-duplex relay terminal. It is shown that 
the optimal DMT can be achieved by a compress-and-forward 
type relaying strategy in which the relay quantizes its received 
signal and transmits the corresponding channel codeword. It 
is noteworthy that, with this transmission protocol, the two 
transmissions in opposite directions can achieve their respective 
single user optimal DMT performances simultaneously, despite 
the interference they cause to each other. Motivated by the 
optimality of this scheme in the case of the two-way relay 
channel, a novel dynamic compress-and-forward (DCF) protocol 
is proposed for the one-way multi-hop MIMO relay channel for 
a half-duplex relay terminal, and this scheme is shown to achieve 
the optimal DMT performance. 

I. Introduction 

Relays have found applications in many wireless networks 
to enhance coverage, reliability and throughput. Following 
[1] and [2] there has been a growing interest in developing 
cooperative relaying techniques for wireless systems. While 
one-way relaying has been widely considered in the litera- 
ture, in most practical communication scenarios data flows 
in both directions. Hence, the relay can be used to improve 
the performance of both transmissions simultaneously. This 
pragmatic approach has been modeled as the two-way relay 
channel in the literature and has attracted significant recent 
interest [3], [4], [5]. Although many involved transmission 
schemes have been proposed for communication over two- 
way relay channels [3], [6], [7], the capacity region remains 
open. 

In this paper, we consider a "separated" two-way relay 
channel (sTRC) [6], in which the two users can receive signals 
only from the relay terminal (see Fig. [TJ. In practice, this 
corresponds to a scenario in which the users are physically 
separated and the signals received from each other are negli- 
gible, such as two distant land stations communicating with 
a satellite, or two mobile users located on opposite sides of 
a building communicating with the same base station on top 
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Fig. 1 . The (Mi , M2 , M3 ) separated MIMO two-way relay channel model. 
There is no direct link between the user terminals 51 and S2. 



of the building. When there is no direct connection between 
the two wireless terminals, relays are essential to enable 
communication. 

We consider multiple antennas at each terminal and model 
the channels between the users as quasi-static, independent, 
frequency non-selective Rayleigh fading channels, and assume 
that perfect channel state information (CSI) is available only at 
the receivers. Our focus here is on the diversity-multiplexing 
tradeoff (DMT) analysis for the multiple-input multiple-output 
(MIMO) sTRC. DMT analysis, introduced in [8], is useful in 
characterizing the fundamental tradeoff between the reliabil- 
ity and the number of degrees-of-freedom of a system. We 
measure the reliability by the diversity gain, defined as the 
rate of decay of the error probability with increasing SNR, 
and measure the degrees-of-freedom of the system by the 
spatial multiplexing gain, defined as the rate of increase in the 
transmission rate with SNR. The optimal DMT of a point-to- 
point MIMO system is characterized in [8], and it is shown 
to be a piecewise linear function. 

When only one of the users is active, the sTRC model 
reduces to a MIMO multi-hop relay channel, for which the 
optimal DMT is characterized in [9]. For a full-duplex re- 
lay terminal the optimal DMT for this multi-hop setup is 
achievable by decode-and-forward (DF) relaying. On the other 
hand, if the relay is constrained to half-duplex operation, 
fixed time allocation schemes fall short of the optimal DMT 
performance, while the dynamic decode-and-forward (DDF) 
protocol, introduced in [10], can be shown to be DMT-optimal. 

In this paper, we show that in sTRC the DF protocol fails 
to achieve the optimal DMT performance even in the case 
of a full-duplex relay. Enforcing the relay terminal to decode 
both messages limits the achievable multiplexing gains due 
to the additional sum-rate constraint. As an alternative, we 



consider a coding scheme based on compress-and-forward 
(CF) relaying [11] in that the relay does not decode the 
underlying messages of the users. Instead, the relay quantizes 
its output and broadcasts the quantized output to the users 
using the coding scheme in [6], [7]. In this coding scheme, 
transmission of the relay's received signal to the users is 
considered as a lossy joint source-channel coding problem in 
which the receivers (the two users in our setup) have side 
information (their own transmit signals) correlated with the 
underlying source signal. This joint source-channel coding 
problem is studied in [12], [13] in detail from the achievable 
distortion perspective at the receivers. 

In [6], it is shown that this CF scheme achieves rates 
within a half bit of the capacity region in the Gaussian setting 
with single antenna terminals. Here we show that the CF 
protocol achieves the optimal DMT performance in the case 
of multiple antenna terminals. Note that, the DMT-optimality 
of the CF scheme is shown in [14] for multiple antenna 
relay channels and in [15] for multiple antenna two-way relay 
channels. However, both of these works assume the availability 
of perfect channel state information at the transmitters which is 
then used to decide the optimal quantization noise covariance 
as well as the optimal relay listening time when the relay 
is half-duplex. Here we propose a transmission protocol that 
does not necessarily choose the optimal values for these 
variables, and hence does not require instantaneous channel 
state information at the transmitters, yet achieves the optimal 
DMT performance. 

We also consider the multi-hop MIMO relay setup (equiva- 
lent to the sTRC with only one user transmitting), and propose 
a dynamic CF (DCF) protocol for a half-duplex relay terminal. 
We show that DCF achieves the optimal DMT performance 
characterized in [9]. This idea can also be used to extend the 
DMT analysis of sTRC to a half-duplex relay terminal. 

The rest of the paper is organized as follows. In Section 
HI1 we introduce the system model. Section [Til] is devoted to 
the DMT analysis of sTRC with a full-duplex relay terminal. 
We consider both the DF and the CF protocols and show that 
the optimal DMT is achieved by the CF protocol. In Section 
IIVI we propose a novel dynamic CF protocol for communi- 
cation over multi-hop MIMO half-duplex relay channels, and 
prove that it is DMT-optimal. Our conclusions and appendices 
containing proofs of our results follow. 

II. System Model 

We consider the sTRC composed of two users S\ and S2, 
with Mi and M2 antennas, respectively, and a relay terminal R 
with M r antennas, as in Fig. Q] We call this an (Mi , M r , M2) 
system. Over a block of T symbols, the received signal at the 
relay is 

- " ^h 1 x 1 + ^h jX2 + w, a, 

while the received signal at user i, i = 1, 2, is 



Yi = J— ;r- H i+2 X r + Wi. (2) 



Here W r G € M - xT and W l G C M * xT , i = 1,2, are 
the additive noise components, whose entries are complex 
Gaussian random variables with independent and identically 
distributed (i.i.d.) zero mean, variance 1/2 Gaussian real and 
imaginary components, denoted by CAf(0, 1). Channels are 
assumed to be frequency non-selective, quasi-static Rayleigh 
fading and independent of each other; that is, for i — 1,2, 
H, g <£M t xau an(J H . +2 £ € auxm t ^ me channel matr i ces 

with i.i.d. entries distributed as CAf(0, 1). We have short-term 
power constraints at the two users and at the relay given by 
trace(£'[Xf Xi]) < M, t T for i = 1, 2, r. 

We assume that the channel realization is perfectly known 
by the receiving end of each transmission. We also assume that 
the realizations of Hi and H2 are known by the users at the 
end of T symbols. This can be accomplished by broadcasting 
at a small rate e > from the relay terminal the quantized 
versions of both channel coefficient matrices to the users with 
arbitrarily small error. It can be shown that this does not 
effect the DMT analysis and arbitrary low quantization noise 
variance can be achieved as T goes to infinity. 

Following [8], for increasing SNR we consider a family of 
codes and say that the multiplexing gain of user i is r, if the 
user's rate i?j(SNR) satisfies, for i = 1,2, 

Ri (SNR) 

1TT1 = V ■ 

SNR^oo log(SNR) 
and the corresponding diversity gain of user i is di if, 

log Pj (SNR) 

di = — lim ; : — , 

SNR^oo log(SNR) ' 

in which P e '(SNR) is the error probability of user i. In the 
rest of the paper, we consider codes with sufficiently long 
codewords so that the error event is dominated by the outage 
event. For each (ri, r 2 ) pair, we want to characterize the set of 
achievable diversity gain pairs (dijtfo) denoted by T>{ti,t%). 

III. DMT of MIMO sTRC with a Full-duplex Relay 

We start with an outer bound on the achievable diversity 
gain region T>(r '1^2) for any pair of multiplexing gains 
(ri, r 2 ). Then we consider DF and CF protocols and compare 
their achievable performances with the outer bound. 

Proposition 3.1 : For any given (ri,r 2 ), if (di,e? 2 ) G 
T^{fi,T2) then we have dj < d^* ,M r (fi) for i = 1,2, where 
M* = min{Mi, M 2 } and d M , N (r) is the optimal DMT for a 
point-to-point MIMO channel with M transmit and N receive 
antennas. 

Proof: This outer bound can be obtained easily from 
the usual cut-set bounds by considering each user separately, 
assuming the other one is silent. For example, for user 1, the 
DMT is bounded by 

di < min{d Ml ,M r (ri ) , d Mr ,M 2 {ri ) } 
= d M *,M r {ri)- 



A. Decode-and-Forward Relaying 

Here, we characterize the achievable DMT with DF re- 
laying. Due to the joint decoding requirement at the relay 
terminal, the DMT becomes involved when we allow different 
diversity gains for the two users; thus similar to [16] we 
assume that the users have the same diversity gain requirement 
d. We define "R,Bp{d) as the set of achievable multiplexing 
gain pairs for which both users achieve a diversity gain of d. 

From Proposition 13.11 it easily follows that for any 
(r 1 ,r 2 ) G TZ DF (d), we have < r M *,M r (d), where r M:N (d) 
is the multiplexing-diversity tradeoff curve for a point-to-point 
MIMO channel with M transmit and TV receive antennas. 

In DF relaying, we use a block Markov structure, that 
is, each user transmits its message in blocks, and at each 
channel block the relay forwards the messages it decoded from 
the previous channel block. This transmission scheme is a 
combination of a multiple-access phase and a broadcast phase, 
which take place simultaneously for consecutive data blocks. 
In the broadcast phase, the relay uses the coding scheme 
first introduced in [17] (see also [5], [18]) for broadcasting 
a source to two receivers with correlated side information. 
Here we consider decoded messages at the relay as the source 
signal, and each user's own message as the correlated side 
information. The achievable multiplexing gain region by DF 
is found as follows. 

Theorem 3.2: K F D ^(d) = {(ri,r 2 ) : < r l < 
rM'.M r {d), i = 1,2, and n + r 2 < r Ml +M 2 ,M r (d)}. 

We skip the proof of the theorem due to space limitations, 
but the analysis of the multiple access phase follows similarly 
to [16], while the broadcast phase follows similarly to the 
analysis of the CF scheme that will be given below. Note that, 
compared to the outer bound, the achievable multiplexing gain 
region in Theorem 13.21 has an additional constraint due to the 
decoding requirement at the relay. Hence, these two bounds 
do not meet in general. 

Corollary 3.3: For a given common diversity gain d, if 

rM*,M r (d) < -r Wl+ M 2 ,M r (rf) (3) 

then DF relaying achieves the optimal multiplexing gain region 
of the full-duplex MIMO sTRC. 

Since the optimal multiplexing gain region is a square, the 
optimal operating point is the corner point where both users 
achieve a multiplexing gain of tm* ,m t (d). Also notice that, for 
a given system, optimality of DF is achieved for all diversity 
gains up to d* for which (O is satisfied with equality. Hence, 
for high diversity gains, or equivalently for low multiplexing 
gains, DF achieves the optimal performance for each user, in 
which case the transmission in either direction takes place as if 
the other user is silent. This is similar to the conclusion in [16] 
for multiple access channels, in which case each user achieves 
the optimal single-user DMT for a lightly-loaded regime of a 
limited number of users. Also note that DF relaying does not 
require any additional channel knowledge other than the CSI 
at the receivers. 



B. Compress-and-Forward Relaying 

Now we consider a compress-and-forward (CF) transmis- 
sion protocol at the relay. In this protocol, the relay broadcasts 
a quantized version of its received signal to the users. Since 
each user knows the signal it transmitted in the previous block, 
they have access to correlated side information. This, similar to 
the DF protocol, can be seen as a joint source-channel coding 
problem with correlated side information at the receivers. The 
difference is that we want lossy reconstruction at the receivers 
instead of lossless transmission [12], [13]. 

In [6], [7], coding schemes for the sTRC based on the 
joint source-channel coding approach are studied. Note that 
the proposed coding scheme is different from the classical 
CF relaying in [11], where the relay applies separate source 
and channel coding to its received signal. In the case of a 
Gaussian sTRC, it is shown in [6] that the proposed CF 
scheme achieves within a half bit of the capacity region. 
Here we consider this scheme with joint decoding at the 
receivers, that is, each receiver directly decodes the message 
from the received signal and its own transmitted codeword 
without explicitly decoding the quantized relay signal. This 
joint decoding scheme is proposed in [19] for communication 
with decentralized processing and in [7] for the sTRC. 

Theorem 3.4: For given multiplexing gains r\ and r 2 , the 
optimal DMT for the sTRC with a full-duplex relay is char- 
acterized by 

T>{n,r 2 ) = {{di,d 2 ) :0<di< d M *,M r (n),i = 1,2}, 

and this optimal DMT is achieved by CF relaying. 

Proof: A sketch of the proof of the theorem is given in 
Appendix [I] ■ 
Consider for example the symmetric multiplexing gain 
scenario with r\ = r 2 = r. In this case, each user can achieve 
a diversity gain of d^i* ,M r ( r )- Consequently, compared to a 
system with one-way communication the CF protocol pro- 
vides the same reliability while doubling the total number 
of degrees-of-freedom. An important question that we are 
currently exploring is whether this result is scalable with 
the number of relays or with the number of users. Note 
that the DF scheme can be extended to multiple relays or 
multiple users easily, while the proposed CF scheme requires 
forwarding of the CSI over the network which will increase the 
complexity significantly with the increasing number of relays. 
Furthermore, the performance of CF depends heavily on the 
fact that each user, knowing its own transmission, can receive a 
good description of the other user's signal from the quantized 
relay received signal. As the number of users increases this 
advantage will disappear due to the inevitable interference 
among multiple transmissions from the remaining users. 

IV. Multi-hop MIMO Channel with a Half-duplex 
Relay 

In channels with half-duplex relays, it has been shown in 
[9] and [10] that fixed time allocation between relay's listen 
and transmit modes is suboptimal. A dynamic DF protocol 
(DDF) is proposed in [10] which is shown in [9] to achieve 



the optimal DMT for multi-hop MIMO relay systems. In DDF, 
the relay listens to the source transmission until it decodes 
the message, and then starts forwarding it to the destination. 
Our goal here is to develop a dynamic CF (DCF) protocol 
that achieves the optimal DMT performance in the multi-hop 
scenario. This is a first step towards extending our results 
in Section IIII-BI to sTRC with a half-duplex relay. For the 
analysis, we consider the same system model as in Section HIl 
with i?2 = 0, i.e., only user 1 is transmitting. 

In the DDF scheme, the amount of time the relay remains 
in the listen mode is naturally decided by the time the relay 
accumulates enough mutual information to be able to decode 
the message. Then the relay reencodes and forwards the 
message to the destination. However, in the CF protocol, since 
the relay does not decode the message, it is not clear when it 
should start forwarding. If, replicating DDF, the relay listens 
until the accumulated mutual information is exactly sufficient 
to decode the message, and then forwards a quantized version 
of its received signal to the destination, this surely will not 
be sufficient for decoding at the destination due to the data 
processing inequality. 

In the DCF protocol we propose, at each channel realization, 
the relay listens until it could have decoded a message of rate 
Ri + 1 rather than the rate of the message R\. If t(Hx) is 
the random variable denoting the time the relay is in the listen 
mode, we have 

tm ) 1 + Rl 

The relay then quantizes its received signal up to that point, 
and transmits a channel codeword corresponding to this quanti- 
zation codeword similarly to the coding scheme for full-duplex 
sTRC in Section ITH-BI Since the relay knows the message rate 
and the realization of Hi, it can decide on the listening time 
dynamically at each channel realization. We have the following 
result whose proof is sketched in Appendix [TT] 

Theorem 4.1: The DCF protocol is DMT-optimal for multi- 
hop MIMO half-duplex relay channels. 

This DCF protocol, to our knowledge, is the first dynamic 
protocol based on CF relaying, and does not require CSI at 
the transmitters. 

V. Conclusions 

We have considered a multi-hop MIMO relay network with 
two-way data transmission. The capacity region for this system 
remains open, and other than some special cases, no known 
transmission strategy can simultaneously provide the users 
with their single user rates due to their mutual interference. We 
have analyzed this system in terms of the achievable diversity- 
multiplexing tradeoff. Interestingly, for a full-duplex relay, we 
have shown that the two users can simultaneously achieve their 
optimal DMT performance as if they were the only transmitter 
in the system; hence we conclude that the two users do not 
interfere with each other (in terms of the DMT performance). 

We have shown that the optimal DMT performance is 
achieved by a compress-and-forward strategy that does not 
require the instantaneous channel state information at the 



transmitters. We have then proposed a dynamic version of this 
scheme, called the dynamic compress-and-forward (DCF) for 
multi-hop MIMO relay channels, and showed that this scheme 
achieves the optimal DMT performance. We are currently 
working on the performance of the DCF protocol for multi-hop 
MIMO two-way half-duplex relay networks. 

Appendix I 
Proof of TheoremI3.4I 



We assume Gaussian codebooks for both the channel coding 
and the quantization at the relay. Let Ri = log SNR, for 
% = 1,2, and define 



a (H^ 4 log 



SNR 
~Mi 



HH 



(4) 



for i = 1,...,4. We supress the dependence on Hi's for 
notational convenience. 

At the end of each channel block, the relay first quantizes 
its received signal. Let 

Y r 4 Y r + Q, 

where Q G C MrXl is a zero-mean complex Gaussian vector 
with identity covariance matrix, i.e., Q ~ CAf(0, 1). In 
the coding scheme, 2 n ( / ( Y '' ;Y ') +£ ) quantization codewords 
and channel codewords are generated with distribution 
and Px r , respectively. For each received signal the relay 
finds the jointly typical quantization codeword and transmits 
the corresponding channel codeword. Each receiver directly 
decodes other user's message from its received signal and its 
own transmitted codeword through joint typicality decoding. 
See [7] for details of the decoding scheme and the probability 
of error analysis. 

Consider decoding at user 2. The message of user 1 can be 
decoded successfully if, 

Ri <min{[/(X r ;Y 2 )-/(Y r ;Y r |H 1 ,H 2 ,X 2 )]+ ) 

I(X 1 ;Y r |H 1 ,H 2 ,X 2 )}, (5) 

where [x] + = max{0,a;}. Note here that both channel states 
Hi and H 2 are assumed to be perfectly known at user 1 when 
decoding. The quantized channel states with arbitrarily small 
quantization noise variances can be broadcast from the relay 
together with the quantized received signal. 

Then using the union bound, the outage probability for 
decoding at user 2 can be bounded as 

PL < Pr{i?i > [C 4 - 1] + } + Pr{#! >C 1 }, (6) 



where we defined, for i = 1,2, 



Q(H,)^log 



SNR 
2M" 
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Let A» i, . . • , \i,m? be the nonzero eigenvalues of H;Hj , 



(7) 



and suppose A» . 



SNR _Qi ' J for j = 1,...,M*, i 



1, ... ,4. We have M 3 * = M{ = min{Mi,M r } and M| 
M 2 * = mm{M 2 , M r }. Then we havsj] 



Ci(Hj) = lo g n(l + ^A 

3=1 ^ 



= log]JSNR (1 - ai 



(8) 



We also have Cj(Hj) = Cj(Hi). Using these exponential 
equalities, we can obtain the following from ©■ 

Pl ut =Pr |n log SNR > log SNR S4(a4) } 

+ Pr | n log SNR > log SNR Sl (ai ) } 

=SNR~ djUr ' Af2 ^ ri ' + SNR _dA/l,A/r ^ 1 ' ) 
=SNR _dM * > Mr ' 

where we have defined Si(cti) = X)j=i(l ~ a i,j) + f° r 
i = 1, . . . ,4, and used the result from [8] for the second expo- 
nential equality. The same arguments can be similarly applied 
to the other message as well. Comparing this achievable DMT 
of the CF protocol with the outer bound in Proposition 13.11 
concludes the proof. 

Appendix II 
Proof of Proposition ETT] 



Due to space limitations, we give only a sketch of the proof 



gi+i 

Cr 



We have 



here. The relay listens for tT symbols with t 
outage if t > 1. In the remaining tT symbols, with t = 1 — t, 
the relay quantizes the received symbols and transmits the 
corresponding channel codeword as in Appendix U 
The probability of outage can be bounded as follows. 



Pl ut <Pr {t > 1} + Pr {Ri > iC 4 - t} 
+ Pr{i?i > tCi) 

=PrU>fl-^U 1 + Rl 



(9) 



C 1 



Pr {R t > Ci - 1} + Pr { R 1 > i±r^& 

L>1 



(10) 



Ci 



Pr{i?! > d- 1} 



+ Pr|i?i > 
<Prii?i > 



Ci-d 
C\Ci± — C4 — 1 



1 + Ci + d 

where the last inequality follows since C\ > C\ > C\ — 1. 

'Define the exponential equality as /(SNR)=SNR C , if 
linigNR— »oo '"nf rkt?^ = c. The exponential inequalities < and > 



log SNR 
are defined similarly. 



Then we have 
PL<Pr\Ri > \+?*{Ri > Ci} 



=Pr <^ Ri > 



C1C4 
C1 + C4 



--Pin log SNR > 



log SNR Sl(Ql) log SNR S4(a4) 
logSNR Sl(ai) +logSNR S4(a4) 



=P<n> 



61(01)54(04) 

Si(qi) + 54(04) 



where, as before, we have 5;(oj) = Y^j^iO- 



Now, comparison of this outage probability expression with 
the outer bound given in [9] reveals that the two match, and 
we achieve the optimal DMT performance. We do not have a 
general explicit expression for the optimal DMT of a MIMO 
multi-hop relay system as in the case of point-to-point MIMO 
channels [8]; however the tradeoff can be obtained numerically 
from the optimization problem given in [9]. 
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